Vessel-following model for inland waterways based on deep reinforcement learning

نویسندگان

چکیده

With the growth of traffic on inland waterways, autonomous driving technologies for vessels will gain increasing significance to ensure flow and safety. Inspired by car-following models road traffic, which demonstrated their strength reduce stop-and-go waves increase efficiency safety, we propose a vessel-following model waterways based deep reinforcement learning (RL). Our is trained under consideration realistic vessel dynamics environmental influences, such as varying stream velocity river profile, with reward function favoring observed following behavior comfort. Aiming at high generalization capabilities, training environment that uses stochastic processes leading trajectory dynamics. safe comfortable in different unseen scenarios, including Middle Rhine. In comparison an existing model, our was able early anticipate safety–critical situations, resulting higher safety while maintaining comparable further experiments, proposed approach its potential dampen oscillations congestion using sequence followers.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm

: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...

متن کامل

Deep Episodic Value Iteration for Model-based Meta-Reinforcement Learning

We present a new deep meta reinforcement learner, which we call Deep Episodic Value Iteration (DEVI). DEVI uses a deep neural network to learn a similarity metric for a non-parametric model-based reinforcement learning algorithm. Our model is trained end-to-end via back-propagation. Despite being trained using the model-free Q-learning objective, we show that DEVI’s model-based internal structu...

متن کامل

Multi-task learning with deep model based reinforcement learning

In recent years, model-free methods that use deep learning have achieved great success in many different reinforcement learning environments. Most successful approaches focus on solving a single task, while multi-task reinforcement learning remains an open problem. In this paper, we present a model based approach to deep reinforcement learning which we use to solve different tasks simultaneousl...

متن کامل

Vision-based Deep Reinforcement Learning

Recently, Google Deepmind showcased how Deep learning can be used in conjunction with existing Reinforcement Learning (RL) techniques to play Atari games[11], beat a world-class player [14] in the game of Go and solve complicated riddles [3]. Deep learning has been shown to be successful in extracting useful, nonlinear features from high-dimensional media such as images, text, video and audio [...

متن کامل

mortality forecasting based on lee-carter model

over the past decades a number of approaches have been applied for forecasting mortality. in 1992, a new method for long-run forecast of the level and age pattern of mortality was published by lee and carter. this method was welcomed by many authors so it was extended through a wider class of generalized, parametric and nonlinear model. this model represents one of the most influential recent d...

15 صفحه اول

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Ocean Engineering

سال: 2023

ISSN: ['1873-5258', '0029-8018']

DOI: https://doi.org/10.1016/j.oceaneng.2023.114679